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INTRODUCTION 



Since the late 1980s, Americans have been inundated with media reports describing the 
increasingly dire circumstances surrounding our nation’s children. Families in the United States are beset 
by urgent problems, including poverty, teenage pregnancy, single parenthood, substance abuse, limited 
health care, and inadequate and unaffordable housing (Levy & Copple, 1989). These problems place 
children at risk of educational failure and, by necessity, place schools at the center of interconnected 
social problems. Public and private community agencies provide services such as counseling, financial 
assistance, medical treatment, and job training for at-risk children and their families. Many of these 
agencies, however, are subjected to heavy caseloads, limited resources, and isolation from other related 
service providers (Chang, Gardner, Watahara, Brown, & Robles, 1991). Many professional groups now 
agree that the problems of at-risk children and their families cannot be tackled by our schools alone 
(Council of Chief State School Officers, 1989). Kirst (1991a) warns that schools may no longer exist 
in isolation, relying on their school boards and separate property taxes to guarantee the well-being of 
students and programs. Rather, broader social policies must be established to protect the nation’s at-risk 
children and their families. One response to the call for broad social policies has been the establishment 
of interagency, collaborative programs that link schools and other service agencies. 

A variety of programs for school-linked health and human, services delivery are being created 
across the country to implement innovative strategies to provide services to children and youth in high- 
risk circumstances. These programs reach out to those at greatest risk and mobilize resources to reduce 
and prevent school dropout, substance abuse, juvenile delinquency, teen pregnancy, and other forms of 
so-called "modem morbidity." Nearly all of the "school-linked" programs seek to develop feasible ways 
to build connecting mechanisms for effective communication, coordinated service delivery, and 
mobilization of the latent energies and resources of communities. 

Although educators and social service agencies have enthusiastically embraced collaborative 
programs, their effectiveness has not been empirically established. Most innovative programs have not 
provided evidence of replicable, long-term, beneficial effects on sttidents. The lack of empirical bases 
for assessing the near- and long-term impact of these innovations has been noted as a source of concern. 
Schorr (1988) concludes that: "Many Americans have soured on ‘throwing money’ at human problems 
that seem only to get worse. They are not hard-hearted, but don’t want to be soft-headed either" (p. 
xvii). Increasingly, many Americans recognize the problem of costly social programs that are not 
evaluated for their effectiveness through careful documentation of immediate, intermediate, and long-term 
effects. They argue that evaluators too often assess only the impact of narrowly defined services, but fail 
to assess the combined effects of multiple-focus interventions. Policymakers, on-line professionals in 
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schools, and the various service delivery agencies do not have adequate information about program 
features and the implementation of innovative programs. A data base of systematically collected empirical 
findings on the range and relative effects of collaborative school-linked services serving at-risk children 
and their families is just being established. 

This paper systematically reviews research on the effectiveness of collaborative school-linked 
programs. It first briefly discusses the history and current state of the practice of collaborative school- 
linked programs. Then the design and findings of 55 school-linked programs, which have collaborative 
elements that have been either evaluated or researched, are summarized. Finally, conclusions are drawn 
concerning the impact of these programs on students and families, and implications for research and 
practice are discussed. 

A Brief History of Collaborative School-Linked Services 

Since the 1890s, improving the plight of at-risk children has been one of the goals of school 
systems in the United States (Tyack, 1992). For over 100 years reformers have advocated using schools 
as a base from which a number of social ills could be remedied. Tyack (1992) provides a historical 
analysis of the development of school-linked services that documents the waxing and waning popularity 
of collaborative programs to meet the needs of at-risk students and their families. He finds that the past 
century has demonstrated that school reform, including the provision of health and human services, 
typically occurs from the top down, with advice from the community being ignored and programs 
intended for the poor frequently rooted in the wealthiest communities. 

Reformers in the 1890s campaigned for increased services for at-risk children. They advocated 
medical and dental examinations, school lunches, summer academic programs, recreational activities, and 
school-based child welfare officers. Many of the health-oriented programs of the 1890s were based on 
a philosophy of improving the human capital of the nation’s children and ensuring equal educational 
opportunity for them. However, reformers were not convinced of the capacity of parents, especially 
immigrant parents, to provide for all their children’s needs. Sadly enough, social reformers rarely sought 
input from parents as they designed and implemented these new services. In his analysis of health and 
human services in public schools from a historical perspective, Tyack (1992) notes that, while parents 
recognized the value of health and medical services provided, including improved nutrition, access to 
physical education, and academic remediation, some parents found these programs intrusive and 
sometimes fought these reforms to preserve their own authority, as well as their ethnic, religious, or 
community values. Political reactions to these programs varied. Conservatives expressed concern that 
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the school’s academic mission would be diluted. Progressive educators lauded the new services and 
believed that without these services students would drop out of school. Financial officers worried about 
finding money to support the new services. Despite these varied reactions, collaborative school-linked 
services were entrenched in our nation’s public schools by the end of the 1930s. 

Tyack (1992) reports that during the Great Depression, budgets and staffs for school-based 
services, especially those devoted to improving children’s health, increased. By 1940, almost all cities 
over 30,000 had some form of public health service (70% run by the schools, 20% by health 
departments, and 10% by a collaboration of both). Other services, such as lunches and mental health, 
did not enjoy such sustained commitment but reappeared after World War II. During the late 1940s, 
school lunches became the norm, despite conservative fears of establishing a paternalistic state. Mental 
health programs were instituted in well-to-do school districts during the 1950s and in poorer ones in the 
1960s to address the dropout problem. During the 1960s, education was viewed as the vanguard against 
poverty, and funding for school-based social services was increased. The collaborative programs 
established after World War II were more sensitive to the limitations of top-down models of reform and 
involved a greater degree of community participation. The enlarged role of the community, however, 
sometimes spawned conflicts concerning program goals and operations among community groups, school 
officials, and service agencies. Despite these difficulties, Lyndon Johnson’s "War on Poverty" had 
reached millions of children by 1970, and collaborative programs had found a niche in public schools. 
Collaborative programs received support from influential community groups; did not clash with prevailing 
instructional approaches; and met some of the needs of poor, at-risk children. 

Tyack (1992) showed how collaborative programs were transformed as they became established 
in the public schools. To handle truancy, for example, some of the school social workers became part 
of the school’s bureaucracy. This change represented a shifting of goals among school social workers. 
In an effort to enhance their professional status, some social workers began to base their work on models 
from mental health and psychology, while others began to work with more privileged clients. To ensure 
the political viability of new social services, legislators often generalized such programs to the general 
public. Services were delivered best in wealthy communities with large property tax bases. Thus, both 
the children of the wealthy and the poor became recipients of collaborative interagency services originally 
intended only for at-risk students. 

During the late 1970s and early 1980s, the role of the schools shifted toward producing students 
who could compete in the global marketplace and maintain the nation’s competitiveness. This shift 
combined with significant budget cutbacks reduced some of the social services provided. Despite the 
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reduction in services, teachers accounted for 70% of all school employees in 1950 but only 52% by 1986, 
indicating that schools had become multipurpose institutions that looked beyond the academic performance 
of their students (Tyack, 1992). 

Not everyone views collaborative programs and school-linked services as the panacea to meet the 
needs of at-risk students. In the controversial book Losing Ground . Charles Murray (1986) argued that 
government services, including school-linked collaborations, produced long-term negative consequences 
for recipients. He maintained, for example, that raising welfare benefits increased the welfare rolls and 
that school-based health clinics contributed to the increase in the number of unmarried pregnant teenagers. 
Murray cautioned policymakers of the unintended effects that may emerge as government services 
proliferate. 

Kirst (1991b) identified several approaches to reducing the problems that surround at-risk children 
and families, including the use of vouchers, tax credits, a negative income tax, and less costly approaches 
(such as traditional parental care for children). The scope of this paper, however, is limited to the effects 
of collaborative school-linked services in meeting the needs of at-risk children and their families in an 
attempt to answer the question: Do collaborative school-linked services have a demonstrable impact on 
the lives of the at-risk children and families they serve? 

The Current Status of Collaborative School-Linked Services 

In Within Our Reach: Breaking the Cycle of Disadvantage (Schorr, 1988), Lisbeth Schorr 
unambiguously set forth the belief that today’s complex social problems can be ameliorated through 
collaborative social programs. Over the course of 20 years, she gathered information from researchers, 
practitioners, administrators, and public policy analysts. Based on research on risk and protective factors, 
she identified risks that affect the lives of children, including premature birth; poor health and nutrition; 
child abuse; teenage pregnancy; delinquency; family stress; academic failure; persistent poverty; 
inaccessible social and health services; and inadequate housing, medical treatment, and schools. She 
argued that these risks require a societal response, not simply a response from the at-risk child or family. 

Schorr held that there is plenty of information available on both risk factors and effective 
interventions to guide action. She identified three principles that capture the role and funaion of 
collaborations in breaking the cycle of disadvantage: (a) a call for intensive, comprehensive services that 
address the needs of the "whole" child and the community; (b) a recognition that the family should be 
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supported, not displaced, by other social institutions; and (c) a shift in efforts from remediation to early 
intervention and eventually to prevention. She is one of many advocates calling for collaborative, 
integrated services to supplement the schools’ role in society (see Behrman, 1992; Chang et al., 1991; 
Hodgkinson, 1989; Melaville& Blank, 1991; Morrill & Gerry, 1991; National Commission on Children, 
1991). 

Levy and Copple (1989) provide evidence of state-level actions that support the formation and 
implementation of collaborative, integrated school-based services from 1975 to 1989. They record that 
in that 14-year period, 15 written agreements were prepared; 20 interagency commissions were formed 
to coordinate state and local agencies; 88 committees, commissions, and task forces were convened; and 
63 collaborative programs and projects were implemented. These counts demonstrate the groundswell 
of state-level efforts to develop collaborative, integrated services. Further evidence of the popularity of 
collaborations was recently reported in the 24th annual Gallup poll that showed that 77% of adults polled 
favored using schools as centers to provide health and social-welfare services by various government 
agencies ("Public in Poll," 1992). 

A Definition of Collaborative School-Linked Programs 
Reflecting such thinking, many new educational programs have collaborative elements. Bruner 
(1991) identified three critical features of collaborative programs: joint development and agreement on 
common goals and objectives, shared responsibility for the attainment of goals, and shared work to attain 
goals using the collaborators’ expertise. Bruner also found that because collaboration requires shared 
decision making and consensus building, it cannot be imposed hierarchically. He pointed out that 
collaboration is not simply increased communication and coordination, but rather requires the 
development of new joint goals to guide the collaborators’ activity. Morrill (1992) asserted that 
collaboration requires concerted action among committed partners. In this paper, collaboration is defined 
as the process of achieving a goal that could not be attained efficiently by an individual or organization 
acting alone. 



Rationale for Collaborative Programs 

Larson, Gomby, Shiono, Lewit, and Behrman (1992) described the prevalence of children’s 
problems, including increases in incidence and costs. They cited, for example, increases in juvenile 
delinquency and the need for foster care. Other types of children’s problems, such as dropout and 
teenage pregnancy rates, have decreased, but become costlier in terms of benefit expenditures and reduced 
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productivity. Statistics collected on children’s problems appear to support the need for new approaches 
to service systems. Melaville and Blank (1991) identified four flaws in the current system of organized 
services for children: (a) a crisis-oriented system that does not prevent problems, (b) the 

compartmentalization of problems into rigid categories, (c) the lack of communication among various 
agencies, and (d) the provision of specialized services that are not able to address the interconnected 
problems of children and their families. 

Kirst and Kelley (1992) asserted that instrumentalism and incrementalism constitute the dominant 
political pattern evidenced in policy toward at-risk children. Instrumentalism is the justification of social 
interventions by the economic or social returns they produce. Increasingly, individuals recognize the 
nation’s future will require increased productivity on the part of all segments of society, including 
underprivileged families and their children. Therefore, it becomes useful for society to invest in school- 
linked services as a method for meeting the needs of these families. Incrementalism is demonstrated, 
according to Kirst and Kelley (1992), in the legal practice of parens patriae. In the United States, social 
interventions only occur in cases of extreme parental and familial dysfunction. Preventive action is very 
rare. Parens patriae is also related to the traditional American belief in limited government. Given the 
federal budget projections, it is likely that collaborative school-linked services will be implemented to 
increase the efficiency and effectiveness with which social and health care services are delivered to at-risk 
students and their families. 

The development of collaborative school-linked services is a strategy for meeting the complex 
needs of children and their families. Advocates of collaborative programs believe that making agency 
services available in one location, coordinating the goals of the agencies, and involving families, agencies, 
and schools in the development of the goals will improve at-risk students’ quality of life. 

The Role of Schools in Collaborative School-Dnked Services 

Schools have become the location of choice for collaborative programs. Larson et al. (1992) 
explained why schools should serve as the central location for a multitude of agencies that provide 
services for children. They argued that schools are enduring institutions that play a critical role in the 
life of communities. Schools have played this role in the past (Tyack, 1992), and thus can deliver these 
services to children and their families in a less stigmatizing manner. 

Wang, Haertel, and Walberg (in press) described the relationship between educational 
achievements and children’s at-risk status. Because education is a critical component in children’s future 
economic success and personal welfare (Walberg, 1987), many individuals support the location of 
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noneducational services in the local school. These services can help guarantee the educational 
accomplishment of children. Arguably, schools, which are the prime vehicle for delivering academic 
services, should be a central location for noneducational services. An example of schools as a center of 
community services is demonstrated in some AMERICA 2000 schools, which highlight local communities 
as the heart of educational reform efforts (U.S. Department of Education, 1991). 

Types of Collaborative School-Linked IVograms 
Many different types of collaborative school-linked programs have been yinitiated and targeted 
toward the needs of at-risk students (Levy & Shepardson, 1992; Temple University Center for Research 
in Human Development and Education, 1990). The types of collaboratives currently being implemented 
include those directed at parents of young children, teenage parents, pregnant teenagers, dropouts, 
homeless children, and alcohol and drug abusers. According to Levy and Shepardson (1992), there is 
no single model for collaborative school-linked services. Rather, experience shows that collaborative 
programs emerge out of the needs of children and families in local communities. They described 
collaborative school-linked services in terms of the goals of the effort, the services offered, the location 
of services, and the parties responsible for providing the services. Another common characteristic of 
collaborative programs is the provision of curriculum, services, or both. 

Collaborative school-linked programs can be curriculum-based, service-based, or both. 
Curriculum-based programs provide knowledge to recipients. For example, dropout programs may 
provide remedial instruction in basic skills, while teenage pregnancy prevention programs may provide 
information on conception, contraception, and pregnancy. Other examples of curriculum-based 
collaboratives include programs that teach new mothers and fathers about their children’s developmental 
stages, supply information on the effects of drug use, or provide educational activities for preschool 
children. Still other curriculum-based programs devote time not only to providing information but to 
teaching new skills. One example is the drug prevention program that not only provides knowledge about 
the effects of drug use, but also teaches refusal and coping skills. Programs to increase the employability 
of graduating students may provide information on how to use the newspaper to find job listings and teach 
new conununication skills that can be valuable in interviews. Classes that teach new parents skills in 
disciplining children and providing a stimulating and supportive home environment also exemplify this 
approach. 

Some collaborative school-linked services rely on the provision of a range of services to meet the 
needs of the targeted clientele. For example, some collaborative programs extend health and mental 




School-Linked Services-8 

health care, recreation, housing, day care, substance abuse treatment, transportation to appointments, and 
other services. Collaborators in these programs also vary. Some of the earliest modern collaborative 
programs were those in which parents became more actively involved in their children’s education. These 
parent involvement programs brought teachers and parents together to improve the academic achievement 
of children. Other collaborative programs involved health care workers, social workers, psychologists, 
university researchers, businesspeople, community volunteers, and peers. 

Levels of Collaboration 

Collaboration can occur at different levels of the agencies and schools involved. Bruner (1991) 
identified four levels of collaboration. The first level describes interagency collaboration at the 
administrative level, often at top managerial levels in state and local governments. This level of 
collaboration often results in the creation of task forces, coordinating councils, changes in staff 
organization, or incentives and job evaluation systems to promote interagency collaboration. The second 
level of collaboration involves giving incentives to service delivery workers for working jointly with staff 
in other agencies. At this level, service workers develop a knowledge base about other resources in the 
community that can be used to meet the needs of clients. The third level of collaboration involves 
changes within a single agency. At this level, service workers are encouraged to help clients by going 
beyond procedures and rigidly applied rules. New policies are established that allow service workers and 
their supervisors to interact collegially and handle individual cases in ways that promote a balance of 
responsibility and authority. This increases the capacity of service workers to collaborate successfully 
with clients and invoke a more diverse range of services than typically available. The fourth level of 
collaboration exists between the client or family and service workers. In this type of collaboration, the 
service worker and the client work jointly to identify needs and set goals in order to increase the 
self-sufficiency of the client. This level of collaboration often requires creative problem solving and 
cannot be accomplished in rigidly bureaucratic systems. 

Bruner’s (1991) four levels of collaboration apply to schools and social-welfare, juvenile justice, 
mental health, and community services. Although collaboration often occurs first at the top management 
level or at the fourth level reflecting worker-client relationships, it can begin at any of the levels. As 
reported by Levy and Copple (1989), many top-level initiatives are currently promoting statewide 
collaborations. Findings from a systematic review of 55 collaborative programs reflecting the fourth level 
of collaboration between children, parents, peers, social service workers, schools, and health care 
agencies are discussed in the next section. 
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AN ANALYSIS OF EXTANT PROGRAMS 
The Literature Search 

A description of the library search and the selection criteria used to identify the final corpus of 
55 sources included in the current review is presented below. The coding procedure that was applied to 
each source is described, and some general chararteristics of the final set of 55 sources are presented. 
The limitations of the review are also identified. 

The authors used several search strategies to identify the studies of collaborative programs 
analyzed here. A search was made of relevant professional journals in education, public health, public 
policy, and social services, including those geared toward professionals such as school nurses and social 
workers, as well as those oriented toward researchers. Particularly helpful was the article entitled 
"Evaluation of School-Linked Services" (Gomby & Larson, 1992), which identified 16 current 
collaborative programs. In addition, a search of the Educational Resource Information Clearinghouse 
(ERIC) yielded hundreds of reports. The 1992 annual program of the American Educational Research 
Association (AERA) was also examined, and relevant conference papers were secured. Finally, 45 
different organizations were contacted, including state and local agencies as well as project staffs (see 
Table 1). These efforts resulted in the identification of a number of "fugitive" documents that were 
available only from the agency sources and are not yet available in libraries. The authors analyzed these 

reports and articles further to ensure that the programs were collaborations and that the reports contained 
evaluative information. 

Criteria Used for Source Selection 

A few basic criteria were used for the selection of sources for this study. All sources had to 
present results from programs involving school-based collaboration. In any single program, the school 
could be involved as the provider of academic services, the central location where families access social 
and health services, or the goal of the program (i.e., readiness programs prepare children for success in 
school). The programs selected addressed the needs of students from preschool to high school. Although 
some collaborative programs included college students, none focusing on college students was selected 
for this paper. Collaboration or integration among institutions and agencies was a primary aspect of 
programs selected. All the programs were designed to impact the lives of children or their families; were 
implemented in the past decade; and contained an outcome-based evaluation or some measurement of 
short-term, intermediate, or long-term results. Some evaluations contained process or implementation 
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data, but process data was not required for a study or evaluation to be included. Although results from 
meta-analyses and quantitative reports were included in this paper, no secondary analyses were used. 

Coding Features of the Sources 

Table 2 details the 10 kinds of information used for coding each source and the studies and 
programs described in each source. Because this investigation included journals aimed at practitioners 
and researchers, the types of sources included narrative reviews, interventions, program evaluations, 
meta-analyses, and correlational studies. 

First, the type of source (e.g., narrative review, program evaluation) was coded, and limitations, 
such as very small sample size, lack of a control group, or poor instrumentation, were noted. The term 
"methodological limitations" was applied to sources that exhibited these problems. Sample size refers 
to the total number of clients or program sites in the treatment and control groups. For meta-analyses 
and quantitative syntheses, the sample size refers to the number of studies analyzed. The characteristics 
of the sample were also coded. That is, the at-risk population served by each program was identified. 
Program goals and outcomes were recorded for each study. Goals were not inferred, although unintended 
outcomes were recorded when relevant. The collaborator category describes the partners in the program 
being evaluated or described. 

Evidence reported was categorized as numerical (including frequencies, percentages, means, and 
standard deviations), statistical (including hypothesis and significance testing), or qualitative (including 
anecdotes, client statements, or administrator perceptions). Data collection tools were recorded, including 
all methods of gathering information, such as school records, interviews, performance tests, achievement 
tests, and others. In the case of meta-analyses and quantitative syntheses, the data collection tools 
category includes all means used by the various studies cited. Cost data from the studies were broken 
down into three categories: none, minimal, and cost-effectiveness or cost-benefit analysis. When only 
a budget or program costs were mentioned in a report, that information was coded as minimal. The final 
category, curriculum-based versus services, describes whether the collaborative program provided 
education, services, or both to its clients. Examples of curriculum-based and service-based approaches 
to meeting client needs are presented in Table 2. If information was not available for one or several of 
the categories to be coded, then the notation "not stated was entered on the coding form. 
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General Characteristics of the Final Corpus of 55 Sources 
The sources used in this review contain articles from journals, ERIC documents, AERA papers, 
and program evaluations, all published since 1983. The 55 sources identified were then divided into six 
categories: parent education, school readiness, and life skills; teen pregnancy prevention and parenting; 
dropout prevention; alcohol and drug prevention and abuse; integrated services (programs designed to 
integrate services from a variety of different agencies and address multiple risk factors); and parent 
involvement. Many of the 55 sources contained descriptions and evaluations of more than one 
collaborative program. In those cases where enough information was available, each of the programs 
cited was included in the analysis. In the case of meta-analyses, however, no such attempt was made to 
separate out information from each of the studies cited. Six types of data sources comprised the final 
corpus (see Table 3). 
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Limitations of the Search Procedure 

The literature describing collaborative programs is vast, and much of it is composed of internal 
documents that are difficult to obtain. This review examined primarily published studies and, thus, is 
subject to the biases of such papers. The primary limitation of published papers is that they tend to report 
positive and significant findings. However, some "fugitive" documents were obtained; their results, like 
those reported in published Journal articles, were largely positive. Thus, this paper reports findings that 
are largely representative of what is known about the effectiveness of collaborative programs. 

Of greater concern is the lack of information available on the magnitude of effects. This paper 
provides convincing evidence on the direction of outcomes, but not on the magnitude of effects. 

Results within Programmatic Areas 

The results from the present review are organized under six programmatic areas. For each area, 
an overview of programs is presented, the type of research design and evidence collected is described, 
and results are highlighted. Finally, a summary of outcomes across the six programmatic areas is 
presented. 



Parent Education, School Readiness, and Life Skills Collaborative Programs 
The effectiveness of parent education, school readiness, and life skills programs has r^eived 
attention since the 1960s when Head Start programs were regarded as a means of opening up the 
opportunity system and educating poor preschool children. As Head Start, parent-child centers, and other 
early intervention programs were implemented, social scientists were advocating the design of intervention 
studies and the use of social science methods to evaluate their effectiveness (Hewett, 1982). Of the six 
programmatic areas, parent education, school readiness, and life skills is the most thoroughly evaluated 
and researched (see Table 4). 

Overview of Programs 

In the past, collaborative school-linked service programs designed to enhance parent education, 
school readiness, and life skills have had program goals that focused on improving low-income parents’ 
ability to promote the skills and habits of their young children, thus helping the children compete in large, 
middle-class environments. More recently, these programs have activated community resources to 
improve family conditions, parental competencies, and maternal behaviors that can contribute to the 
child’s and family’s healthy development. Most of the programs articulate goals that focus on family 
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literacy, children’s academic achievement, and the provision of health and social services to families. 
The recipients of these services tend to be low-income parents who have young children and little 
education and are living in urban areas. Some of these programs are directed, in particular, at teenage 
parents. 

The collaborators involved in these programs include schools; social and health care workers; 
and, occasionally, private foundations, universities, and churches. Typically, these programs provide a 
combination of curriculum-based information and health and social services. The types of curriculum 
provided include information for parents on developmentally appropriate activities for their children, 
child-rearing practices, and self-help programs to develop parents’ and children’s literacy skills. The 
services most typically delivered include home visits by nurses and social workers, transportation to 
appointments for families, counseling, health screenings, and, occasionally, access to a parent resource 
center. Of the 18 programs described in this programmatic area, 16 of these programs were found to 
provide a combination of curriculum-based information and services. 

Research Design and Evidence Collected 

Eight sources were examined in this programmatic area. These eight sources reviewed results 
from 18 programs. The 18 programs included 10 program evaluations; a narrative review that 
summarized six interventions; an intervention study; and a narrative description of a single program. Of 
the 18 programs reviewed, 11 employed control groups, and 11 collected more than one wave of data. 
Also, within the 18 programs, 13 conducted statistical tests of their outcomes. All but three of the 
programs reported percentages and other numerical indices, including means and frequencies. 

There was a wide range of data collected in these programs, including maternal interviews, 
maternal self-report measures, videotaped observations of mother-child interactions, measures of 
attachment, measures of ego development, maternal and child intelligence tests, medical records, 
anecdotal reports, assessments of the home environment, records of community resource use, and birth 
weights of infants. In general, the paper-pencil measures used were published instruments with 
established reliability and validity. Although it is commonly acknowledged that implementation of 
collaborative school-linked programs of this type is costly, the published accounts fail to address this 
issue. None presented any cost data associated with the implementation of a given program. 
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High rates of attrition were reported in many of the 18 programs reviewed. Results from the 
programs suggest that there were often program-favoring effects on maternal behaviors and mother-child 
interactions, while the effects on infant development were more modest. There were also 
program-favoring effects on the use of community resources and parental participation in job training and 
employment. However, there were more mixed effects on parental teaching skills; some programs were 
more successful than others, depending on the amount of time that was spent focusing on maternal 
interaaions and other specific behaviors. Overall, however, the programs included in the present review 
tended to show success in influencing the outcome domains closest to their emphases, for example, 
children’s readiness for school, parenting skills, maternal development, and use of community resources. 
The long-term effects of these programs are more equivocal. Some earlier evaluations of preschool 
programs, such as Head Start, showed that children’s academic advantages fade over time, but social and 
behavioral effects, such as incidence of retention, special education placement, and remaining in school, 
support the effectiveness of these programs (Lazar, Darlington, Murray, Royce, & Snipper, 1982). 

Teen Pregnancy and Parenting Collaborative Programs 

During the past two decades, interest in adolescent parents, particularly teenage mothers, has 
greatly increased. Some teenage parenting programs have been around for as long as 20 years, but 
formal evaluations are rarely available. There have been few efforts to evaluate the immediate, 
intermediate, or long-term effects of these programs (Roosa, 1986). 

Of the six programmatic areas, teen pregnancy and parenting collaboratives have received the 
least attention from the research community. Only six sources were identified, and they describe seven 
collaborative programs. Five of the seven programs focus on teen parenting and only two on teenage 
pregnancy prevention programs (see Table 5). 

Overview of Programs 

Teenage pregnancy prevention programs typically have two goals: (a) to provide information 
about birth control, sexuality, and pregnancy to teenagers in order to prevent pregnancies; and (b) to 
provide contraceptives. On the other hand, teenage parenting programs often have three goals: (a) to 
provide knowledge about pregnancy and birth control, as well as information on child development and 
parenting skills to teenage mothers; (b) to promote the mother’s completion of her high school education; 
and (c) to promote increased employability and Job skills for teenage mothers. 
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Teenage parenting programs are targeted for teenage mothers, particularly first-time, unmarried, 
low-income, pregnant teenagers. Teenage pregnancy prevention programs are targeted at the more 
general population of young women who are of childbearing age. Occasionally, prevention programs 
have been designed for particular ethnic minorities, such as African-American teenagers living in urban 
areas. 

The collaborators involved in teen pregnancy and parenting programs are diverse. Usually, 
schools, home nurses. Planned Parenthood, and other health and human services agencies are involved 
in prevention programs. In the programs designed for pregnant teenagers, there may be obstetricians, 
midwives, pediatricians, and nutritionists involved. Less frequently, departments of pediatrics and of 
gynecology and obstetrics from university medical schools participate. 

Teen pregnancy prevention and parenting programs .usually provide curriculum-based information 
and services to their teenage clients. The pregnancy prevention programs often develop a curriculum that 
provides information on birth control, sexuality, and family life education. Services to these students 
might include counseling, medical examinations, and contraceptives. The curriculum provided to 
pregnant teenagers who will soon be parents addresses not only issues of birth control and sexuality, but 
also provides information on child care such as child development and health education. Topics such as 
prenatal care and job training are also popular. The services made available to pregnant teenagers include 
prenatal care, transportation to medical appointments, nurse home visitations (both pre- and postpartum), 
medical examinations, well-child care, and developmental screening of children. Of the five teen 
parenting programs, four provided both curriculum-based information and services to clients; the fifth 
program provided services only. Of the two teenage pregnancy prevention programs, one provided both 
services and curriculum-based information, and the other provided only curriculum-based information. 

Research Design and Evidence Collected 

The six sources summarized in this programmatic area include two narrative reviews and four 
intervention studies. Of the seven programs reviewed, six were evaluated using a control group for 
comparative purposes. Three of the seven programs had a longitudinal design. 

The data collection tools used were primarily Interviews, self-reports, pre- and post-knowledge 
tests, and school records. Occasionally, measures of student attitude and maternal IQ were used. Three 
of the seven programs employed statistical tests; the remaining four programs made use only of numerical 
data, including percentages, means, and frequencies; and one of these programs reported some qualitative 
results. No cost information was reported. 
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Results from the teen parenting programs reveal that clients’ knowledge about pregnancy, 
reproduction, and birth control increased. One program showed evidence of a decreased willingness to 
engage in sexual activity at a young age. Most of these programs did not examine client attitudes toward 
the risk of additional pregnancies. Of the three programs that examined school retention of pregnant 
teenagers, all showed positive effects for immediate retention after the child’s birth. One program 
examined the retention of students 46 months after delivery. These results revealed that the clients 
displayed a dropout rate comparable to that of pregnant teenagers who had not been enrolled in the 
program. These programs also provided evidence of increased concern about employment and, in some 
cases, decreased job turnover among the teenage parents. Two of the five programs for teenage parents 
that examined pregnancy rates showed a decline. In the .two pregnancy prevention programs, results 
indicated that participating in the program delayed the age of first intercourse, decreased pregnancy rates, 
and increased the use of birth control clinics and contraception. 

Dropout Prevention Collaborative Programs 

The national dropout rate has been decreasing and may be at an all time historic low (Wehlage, 
Rutter, Smith, Lesko, & Fernandez, 1989). While decreasing overall, local dropout rates are not 
uniformly low; in particular, dropout rates in urban areas remain high. The high dropout rate in urban 
areas has focused attention on the design of innovative programs to meet the needs of urban students at 
risk for dropping out. Although there have been several studies of dropout prevention programs, few 
have carefully evaluated the collaborative components involved. In this programmatic area, nine sources 
were identified. The nine sources included in Table 6 represent results from 25 collaborative programs. 

Overview of Programs 

Dropout prevention programs all strive to increase students attendance and reduce their dropping 
out. Most also strive to increase students’ academic performance and increase their probability of 
attending college or entering the work force. Some of the programs targeted at delinquent and truant 
students with histories of noncompliant behaviors set goals to increase socially desirable behaviors. One 
program included was designed for the purpose of identifying and contacting truant students and students 

who had dropped out. 

The at-risk population tends to be minority high school students in urban areas with a history of 
high absenteeism and course failure. The innovative programs described in the book by Wehlage et al. 
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(1989) serve a more general population of students who are not able to conform to school expectations, 
as well as urban, at-risk students. Not surprisingly, there were high rates of attrition in all programs. 
Dropout programs tend to involve schools, parents, businesses, and departments of family and child 
services as collaborators and, occasionally, university and college collaborators as well. Programs 
targeted for more serious offenders may include the Juvenile justice department. 

Dropout programs often serve clients with several problems in addition to dropping out of school. 
For example, some of these students are involved in criminal activity, alcohol and drug abuse, or teenage 
pregnancy. Because of the complexity of the problepis, collaborators may include drug counselors or 
obstetricians and other professionals providing specialized services. 

Of the 25 programs reviewed, 20 provided both curriculum and service components; four 
provided curriculum-based information alone; and one program provided services only. The curriculum 
in dropout prevention programs typically focuses on remedial basic skills and vocational education. 
Services provided in dropout programs include counseling, mentoring, health services, home visits, and 
telephone calls to homes as a follow-up for absenteeism. ‘ Some programs provide coordination of Job 
Training Partnerships Act (JTPA) placements and preparation for the general equivalency diploma (GED) 
as well. Others are designed specifically around the needs of children who do not conform to typical 
school expectations. Special curricula reflecting the needs of these students are often developed. 

Research Design and Evidence Collected 

The nine sources describing dropout studies include two intervention studies and seven program 
evaluations. There were control groups for 18 of 25 programs reviewed, including the Wehlage et al. 
(1989) review of 14 innovative dropout programs. Although these programs had control groups, their 
degree of comparability was rarely specified. Only three of the 25 programs employed longitudinal 
research designs. All of the 25 programs reported numerical data, including percentages, means, and 
frequencies. Seventeen of the 25 collaborative programs, including the 14 programs described in 
Wehlage et al. (1989), contained statistical tests of data. Sixteen of these programs made use of 
qualitative data in their reports of program effects. 

The data employed included school records (absenteeism, truancy, suspensions, disciplinary 
referrals, and expulsions), interviews, field notes, questionnaires, and achievement tests. Dropout 
prevention programs, like many of the programs reviewed, provided little information on program costs; 
only two of the programs provided some minimal cost data. 
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Findings from the dropout prevention programs reveal mixed effects. All but one of the 
programs increased students’ attendance rates. Most programs increased students’ grade point averages 
and the number of credits earned. Of the studies that examined dropout rates, a decrease was noted. 
Only one program assessed the effects of a prevention program on dropout rates over time, and this 
program indicated a continued decrease in dropout rates. Behavioral indices across all programs revealed 
weak effects. There was no evidence of decreased suspensions. Graduation rates, although improved, 
were still low, and in many schools the number of disciplinary referrals did not decrease. There was 
little evidence of students having more definite graduation plans as a result of participating in the 

programs. 

The study by Wehlage et al. (1989) explored the psychological effects of dropout prevention. 
Their results revealed modest positive effects of the 14 programs on social bonding, sociocentric 
reasoning, self-esteem, locus of control, and academic self-concept. They reported that one quarter of 
students in the dropout programs were receiving additional social services. 



Alcohol and Drug Prevention and Abuse Collaborative Programs 
For the past three decades, young people, their parents, teachers, and government officials have 
been dealing with the problems of alcohol and drug prevention and abuse. Despite great public attention 
and concerted efforts to discourage alcohol and drug use, the number of youth using alcohol and drugs 
has increased, and the age at which they begin using these substances has decreased. Recently, a 
collaborative approach has been used to tackle these problems. These collaborative programs seek to go 
beyond merely imparting alcohol and drug information to providing young people with counseling 
services, drop-in centers, and peer mentors (see Table 7). 

Overview of Programs 

Collaborative alcohol and drug prevention and abuse programs have one overriding goal, to 
reduce the consumption of alcohol and drugs. Toward that main goal, many programs have a number 
of ancillary objectives such as increasing knowledge about drugs and alcohol, promoting skills to cope 
with the pressure to use these substances, teaching responsible drinking habits, and developing positive 

self-esteem. 

Because all young people are considered to be at risk for alcohol and drug problems, the 
programs target a wide population. Some programs address the specific needs of urban minorities. Native 
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those that deliver knowledge about the effects of alcohol and drugs to students and also provide training 
in refusal and coping skills. Results of studies show that students’ knowledge of the deleterious effects 
of alcohol and drugs increased and their problem-solving skills improved with program participation. 
This programmatic area is able to make use of performance tests, such as saliva and breath tests, to 
validate program effects. Although the number of programs represented in the meta-analysis using 
physiological tests was not known, there does not appear to be widespread use of physiological 

performance measures. 

Alcohol and drag prevention and abuse programs provide one of the dearest effects regarding 
the value of collaboration. Based on results of a meta-analysis of 143 programs. Tobler (1986) 
documents the superiority of programs that involve peers as collaborators. This finding is based on a 
mean effect size of .35, which is a moderate effect. For the 143 drag programs synthesized in the 
meta-analysis, a grand mean effect size of .30 was measured over all outcome measures. TTie average 
student in the peer programs moved to the 65th percentile of all outcome measures compared to the 50th 
percentile for control group members. Students in other types of programs moved to the 54th percentiie 
compared to the control group’s 50th percentile. Tllis is a difference in percentiles of 1 1 % between peer 

programs and other types of drug prevention programs. 

The superior effects of peer programs reflect the special influence peers have on one another’s 

behavior and the value of specific skills training. Regardless of the type of drug used, peer programs 
are successful at modifying student behavior. The Tobler (1986) meta-analysis seriously challenges the 
concept that knowledge changes alone will produce attitude changes and corresponding changes in 
behavior. It appears that alcohol and drug prevention programs that use peers as collaborators stand a 
better chance of decreasing student drug use-or at least retarding the likelihood that students will try new 

drugs. 



Integrated Services Programs 

Although the notion of integrated school-linked services for children enjoys great currency today, 
similar ideas have waxed and waned over the past 100 years. Medical screenings, inoculations, school 
lunches, and counseling for students are all examples of nonacademic services that have become 
entrenched in pubiic schoois across the United Sutes during the past century. Current reformers view 
schools as potential sites for providing an even greater variety of services ranging from welfare to job 
training and from chiid care to juvenile justice services. Proponents of such integration argue that current 
service systems cannot respond in a timely, coordinated, or comprehensive manner to social problems. 
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design. Seven reported results using numerical information such as percentages, means, and frequencies. 
Only one reported results using statistical tests. Six of the programs included qualitative data. Two of 

the programs were described using qualitative data alone. 

The types of data collected include school records; teacher and student attitude measures; student 
self-reports; classroom climate measures; achievement tests; and interviews of students, teachers, and 
student personnel. Cost data were reported more frequently in this programmatic area than in any other. 
Five of the nine programs included some minimal information about costs. Often, the cost data provided 
only included a single dollar amount that represented the cost of running the program for one year. 
Occasionally, a program budget was included in the evaluation reports. 

Results 

Outcomes from the programs were diverse. Some programs included institutional changes as 
evidence of program success. Most of the programs measured success using student outcomes such as 
grades, attendance, student attitudes, and evidence of noncompliant behavior. Other sources of evidence 
included degree of parental involvement, teacher attitudes, number of services provided to clients, and 
number of referrals. Outcomes used to measure effectiveness are frequently measured differently, even 
among sites of the same project. For example, average daily attendance is measured several different 
ways by the 35 local sites in the Cities in Schools program (Cities in Schools, 1992). 

The evaluation reports that record the effects of these programs frequently contain information 
describing the evolution of institutional change. Some of these reports, for example, contain descriptions 
of linkages among existing institutions, joint planning and budgeting sessions, the creation of management 
information systems, hiring of case managers, and the forming of business-school compacts. 

In these evaluation reports, quantitative results of program effectiveness were typically reported 
as frequencies, percenuges and means, and standard deviations. Because these programs were often 
locally designed and frequently made use of unique outcome measures, it is difficult to form 
generalizations about their effectiveness. Based on the integrated programs examined here, however, 
several conclusions can be drawn. Integrated services programs have positive effects on students’ 
achievement tests, grades, dropout rates, and attendance. There is some evidence, based on two program 
evaluations, that integrated services can reduce the incidence of teenage pregnancy and delinquent acts. 

Because many of these programs are relatively new, it is impossible to measure their long-term 
effects. Their immediate and short-term effects, however, have been examined. The number of children 
and families receiving services with increased accessibility should be among the most important outcomes 
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considered. All of the nine programs show large numbers of services being provided to at-risk children 
and their families. A second important outcome, which is rarely reported, is the effect of these programs 
on teachers. In the Jewish Family and Children’s Services (1991) project, teachers reported that their 
knowledge of child development and sense of responsibility toward the children increased with program 
implementation. The evaluation conducted by Philliber Research Associates (1991), moreover, suggested 
that children who receive intensive case management exhibited higher academic achievement and better 
work habits despite increased absenteeism. 

Many of the evaluations of integrated services have limited internal validity. For example, the 
control groups, when present, were not shown to be comparable, and the programs often had high rates 
of attrition. Outcomes were locally defined, and many evaluations did not collect several waves of data. 
In order to get a fair appraisal of the value of collaborative activities, these methodological problems must 
be corrected. In addition, it is essential to have sufficient cost data available so that cost-effectiveness 
and cost-benefit analyses can be conducted. 

Parent Involvement Collaborative Programs 

The idea of parental involvement in children’s education is not a new one. At the turn of the 
century, Frederick Froebel, one of the founders of the American kindergarten movement, argued that 
schools should involve parents in the education of their children. Since that time, parental involvement 
has enjoyed consistent support as a worthy idea (White, Taylor, & Moss, 1992). Such involvement 
encompasses a wide array of collaboration, however. Parental involvement can include partnerships 
between families and schools, encouraging parents to play a role in their children’s physical and 
emotional development, and teaching effective parenting and child-rearing skills. All of the parent 
involvement programs reviewed here focused on family-school partnerships (see Table 9). 

Overview of Programs 

School programs to improve parental involvement have not only aimed to foster greater parental 
concern for children’s educational achievement. Typically, they have also set goals of improving 
students’ academic performance in school and creating or improving ways for parents to have input in 
their children’s education. In addition, not all goals are school-based. Many programs aim to empower 
parents, create a more intellectually and educationally stimulating home environment, and promote closer 
family relations. 
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Collaborative programs to foster parental involvement have worked with the families of children 
in preschool through high school. The programs described here primarily involve preschoolers and 
primary school students. Fewer programs involving older elementary and middle school students and 
their families are represented. Although many parent involvement programs are popular in rural and 
suburban schools and with middle-class and majority populations, the programs analyzed in this paper 
operated primarily in urban areas for disadvantaged, at-risk minority populations. 

Schools and parents are the obvious collaborators in any parent involvement program. Some 
programs, however, also involve the wider community or provide support, including psychological and 
social services. Other parent involvement programs have brought businesses, media, and universities into 
collaboration with schools and parents. Although parent involvement programs sometimes provide a 
combination of services and curriculum-based information, the preponderance of interventions are 
curricular. Excluding those programs reviewed in the two meta-analyses, none of the programs analyzed 
in this section provided services only. Two provided a combination of curriculum and services, and the 
remaining one utilized curriculum only. 

Re-search Design and Evidence Collected 

The eight sources reviewed in this programmatic area represent results from over 240 parent 
involvement programs. The two meta-analyses included here— Graue, Weinstein, & Walberg (1983) and 
White et al. (1992)-synthesized results from over 230 programs. (Graue, Weinstein, and Walberg (1983) 
summarized results from 29 programs and White et al. (1992) from over 200 programs.) The remaining 
six sources reviewed included four program evaluations, one correlational research study, and one 
intervention study. 

Both meta-analyses reviewed results of parent involvement programs that were compared with 
control groups, although the comparability of the experimental and control groups was not known. Two 
of the four program evaluations employed control groups; the remaining sources did not. From the data 
presented, it was impossible to determine how many, if any, of the 29 studies in Graue et al. (1983) and 
the over 200 studies in White et al. (1992) contained longitudinal data. Both meta-analyses did, however, 
take into account the internal and external validity of the studies reviewed. Of the remaining six sources, 
two of the program evaluations and the correlational research study collected longitudinal data. All of 
the program descriptions contained numerical data; only two of the programs did not report statistical 
tests; and approximately 1 1 programs were described using qualitative data. 
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The types of data collected included school records of attendance and grades, pre- and post- 
standardized achievement tests, surveys of attitudes, memory and perception tests, study skills tests, 
observations, interviews, records of parent training sessions, and agency logs. Three of the eight sources 
on parent involvement included minimal cost data, describing either total costs or average annual costs 
of programs. As part of the White et al. (1992) meta-analysis, the authors reviewed 20 programs cited 
by prominent reviewers in support of parental involvement; 18 of these programs analyzed costs. Such 
analysis of program costs was rare among the 55 sources reviewed for this paper. 



Results 

Results from the studies suggest that parent involvement programs have weak to moderate positive 
effects on improving children’s academic performance. Although these programs improved parental 
involvement in children’s education and led many parents to believe that school climate had improved, 
however, changes in academic achievement were mixed. Results from one program evaluation and the 
correlational research study indicated that students’ reading scores improved, while their mathematics 
scores remained unchanged, after greater parental involvement. Another program demonstrated gains 
in students’ art and social studies knowledge. A fourth program reported improved student achievement. 

Employing effect sizes to judge the magnitude of program outcomes, the two meta-analyses cited 
here provide conflicting evidence about the effects of parent involvement programs. Using a set of 29 
studies. Graue et al. (1983) found that programs to improve parent involvement and home environment 
in elementary school have large effects on children’s academic learning. On the other hand, employing 
over 200 studies of early intervention programs for preschoolers. White et al. (1992) concluded that 
"average effect sizes of treatment versus no-treatment studies in which parents are involved are about the 
same as the average effect sizes of treatment versus no-treatment studies in which parents are not 
involved." (p. 118) Based on these findings, they concluded that there is no basis for parent involvement 
programs to claim cost-effectiveness. Possible reasons for this lack of effect include poor implementation 
of programs and failure to look at outcomes for families. If parent involvement is advocated because it 
is "a good thing" or because parents have an obligation to be involved, then these findings are irrelevant. 
Those hoping to achieve goals like better student performance and attendance, however, may want to 
consider other avenues toward those ends. 
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SUMMARY OF OUTCOMES 

This paper provides an analysis of the design and effects of school-linked health and human 
services programs that involve collaborations. Overall, the outcomes of these programs are positive (see 
Table 10). Of the 176 outcomes, 140 (or 80%) are positive; 29 (or 16%) provide no evidence of change; 
and 7 (or 4%) are negative. These results provide evidence of the value of collaborative programs. 
Although these results seem robust, they must be treated with guarded optimism. Table 10 does not 
reflect the magnitude of the outcomes summarized. Many of the 55 sources did not specify the magnitude 
of the outcomes; and, thus, only the direction of outcomes could be reported in this paper. The positive 
outcomes summarized include those that reflect small, insignificant improvements and outcomes that 
measure large, statistically significant effects. Negative outcomes also include small and large effects. 

Table 10 contains only selected outcomes reported in the 55 sources. Five of the six outcomes 
included are those that were commonly used in the six programmatic areas. These five outcomes include, 
(a) attendance; 0>) achievement, grade point average, and academic grades; (c) reduced behavioral 
problems; (d) self-esteem; and (e) dropouts. They measure the impact of programs on children’s lives. 

The outcome in Table 10 labeled "special emphasis" represents the main focus of each 
programmatic area. For example, the special emphasis of dropout prevention programs is the reduction 
of dropout rates. The special emphasis of teen pregnancy prevention and parenting programs includes 
a decrease in the number of pregnancies, delayed onset of sexual activity, and an increase in teen 
parenting skills. The special emphasis of integrated services programs is the provision of school-linked 
services to students and their families. Tims, the outcomes summarized in the "special emphasis" column 
reflect whether the key program goals for each of the six programmatic areas have been accomplished. 

Summary of Outcomes by Programmatic Area 

All of the six programmatic areas summarized in Table 10 produce largely positive outcomes. 
The programmatic area with the highest percentage of positive outcomes is integrated services (95%). 
Parent involvement programs had the fewest positive outcomes (68%). Even if 68% is the lowest 
percentage of positive outcomes among the six programmatic areas, this percentage still provides 
empirical evidence of the efficacy of parent involvement programs. 

Table 10 provides information on which programmatic areas have been evaluated using a variety 
of outcomes. The distribution of outcomes within each programmatic area reveals that the teen pregnancy 
and parenting programs included in this corpus of studies have not collected data on the more common 
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outcomes. Many of the outcomes for teen pregnancy prevention and parenting programs are measured 
by changes in knowledge of contraception, reproduction, and pregnancy. The alcohol and drug 
prevention and abuse programs also measure changes in knowledge. They seek to increase students’ 
knowledge about the effects of drugs. Both teen pregnancy prevention and parenting programs and 
alcohol and drug prevention and abuse programs often try to develop students’ refusal and coping skills. 
These cognitive and affective outcomes are unique to particular programmatic areas and are not 
represented in Table 10; instead, they are presented in the text describing the specific programmatic area. 

Some programmatic areas have been evaluated using diverse student outcomes and can provide 
policymakers with a wide array of information about the effects of these programs. For example, parent 
education, school readiness, and life skills programs have been evaluated using a variety of outcome 
measures. Although the outcomes in Table 10 were seized because they were commonly used in 
evaluations, the sparse appearance of the table provides evidence that even these core outcomes are not 
well represented. Results presented in this paper suggest that collaborative programs need to be evaluated 
using the core of common outcomes identified in Table 10 in combination with unique outcome measures. 
Expanding the criteria used to judge collaborative programs is desirable because it increases the likelihood 
of evaluators detecting unintended program outcomes. 

Types of Outcomes Measured 

The five types of outcomes commonly used in evaluations of collaboratives (attendance; 
achievement, grade point average, and academic grades; reduced behavioral problems; self-esteem; and 
dropouts) reveal largely positive results. There was no category of outcomes that revealed less than 76% 
positive effects. These results suggest that collaborative programs do have a positive impact on students’ 
cognition, affect, and behavior. These outcomes tap not only results from paper-pencil tests, but also 
include behavioral measures such as attendance, dropout rates, and counts of behavioral problems, such 
as expulsions and suspensions. The combination of paper-pencil and behavioral measures increases the 
internal validity of the results obtained. 

Attainment of Program Goals 

The outcomes summarized in the special emphasis category are also positive (77%). The special 
emphasis results provide evidence that the collaborative programs largely achieve the goals they set forth. 
However, the magnitude of the effects they achieved is not documented. Although these program 
produce positive results, the size of the effects may be neither statistically nor practically significant. 
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Therefore, the results presented in this paper must be regarded with cautious optimism. Better 
documentation of results is required to conclusively determine the value of collaborative school-linked 

services. 



Some Methodological Concerns 

It is difficult to establish the general izability of the findings because many studies of collaborative 
programs are plagued with methodological problems, including high attrition, control groups that may 
not be comparable, and a wide range of unique outcomes, some of which are based on measures of 
unknown reliability and validity. Most of the descriptions of programs did not contain adequate 
information on implementation. In addition, many did not report the magnitude of program effects nor 
include information on costs, making it difficult to judge the practical significance of the programs. 

Research on school-linked service programs that require multi-agency collaboration suffers from 
several methodological limitations. Several elements contribute to findings of limited value for solving 
the complex problems described In this paper. They include the varied (and sometimes conflicting) goals, 
assumptions, definitions, procedures, and analytic tools used in the design and evaluation of collaborative 
programs; narrowly framed research questions generated by researchers from different disciplines; and 
a service delivery perspective contributed by social and health care agencies. These problems are further 

ex 3 cerbatcd by the lack of good data on implementation. 

Innovative programs are designed and implemented to achieve specific outcomes. It is vital, 
especially during initial implementation of a new program, to provide adequate resources to detwmine 
whether and to what degree project objectives are achieved. Systematic documentation and evaluation 
of the program’s implementation and evaluation are central to the validation and refinement of innovative 
programs. Beyond that, they can contribute significantly to data on the design, planning, and 

implementation process associated with such programs. 

It is generally recognized that use of the traditional "treatment/yield- paradigm within classical 
experimental designs is a necessary, but not sufficient, condition to understand how and why innovative 
programs work. The classical pre- and posttest control group experimental designs, while useful from 
a conclusion-oriented evaluation research perspective, are not sufficient to address such process evaluation 
questions as: What elements of the program need to be implemented (and at what levels) to make the 
program work? What are the critical features of the programs that should be observed to validate 
program implementation? Evaluating the -collaborativeness" of these programs posts a major challenge. 
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Information is needed to further the understanding of what constitutes effectiveness and the 
conditions that influence it. School-linked service integration programs such as those reviewed in this 
paper represent a major step forward in improving the chances of learning success for children and youth 
in at-risk circumstances, including those living in inner-city communities. However, as with most reform 
efforts with broad agendas, these programs are faced with many, and often competing, demands. 
Strategic planning, responsible implementation, and, above all, practical wisdom are required as the many 
dimensions of the program unfold. 

CONCLUSION 

Innovative programs evolve in stages of development, growth, and change. Procedures found 
useful in one city can be helpful to others who are initiating similar programs elsewhere. Strong efforts 
are needed to encourage exploration, to share ideas on solutions to thorny problems, to identify promising 
practices, to analyze how programs are implemented, and to evaluate outcomes. There has been 
insufficient opportunity for persons involved with research and implementation of school-linked service 
integration programs to share understandings and discuss research questions and methodological 
considerations. This is yet another level of collaboration that will contribute to sustained improvements. 
The research and evaluation will yield a much-needed knowledge base on how to provide school-linked 
service integration that is both feasible and effective. 

Evaluating collaborative school-linked health and human services remains a challenge. Direct 
measures of the "collaboration" are sorely lacking. Data are needed, for example, on the accessibility 
of programs; the implementation processes that established the programs; the role of the principals and 
others in leadership positions of the various service agencies; the changing role and modus operand! of 
the staff; the ways in which agency staff are involved in the planning, implementation, and evaluation 
of the programs; and the allocation and budgeting of the cost of the services. Kirst and Kelley (1992) 
concluded that the educational accountability system must be altered to include outcomes that validly 
measure school-linked services. They suggested that in evaluating collaborative programs, outcomes must 
be selected that go beyond paper-pencil test scores. Educators must acknowledge the close linkage 
between the provision of school-linked services and academic outcomes. School-linked services should 
not be perceived as peripheral to the academic mission of schools, but rather as an essential component 
that can reduce the vulnerability of at-risk students and their families. 

Data bases derived from program evaluations that focus on processes and outcomes discussed 
above can be expected to provide information on the technical aspect of initiating and maintaining school- 
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linked service integration programs, as well as on methods for improving implementation research and 
evaluation. Information is needed to further the understanding of what constimtes effectiveness and the 

conditions that influence it. 

A variety of innovative collaborative school-linked programs are being created across the country 
as an alternative to more effectively meet the educational and relaled service needs of children and 
families. A central concern of these programs is how educators and people in various organizations can 

one another’s efforts to improve the prospects of schooling success of children and youth from 
families in at-risk circumstances. Agencies of the community that badly need to coordinate efforts m 
service to people of the city are fractionated, uncoordinated, and disparate. Schools are pan of this much 

disconnected nonsystem. 

One common underlying premise of the emerging "school-community connection" types of 
programs is that the challenges facing children and families stem from a variety of cultural, economic, 
political, and health problems. TTieir solutions are by nature complex. They require the pooling of 
resource from public and private sector agencies such as city and state health and human services 
departments, businesses, religious institutions, and community-based social and medical service agencies. 
They also require negotiation of new forms of cooperation and coordination and new ways of mobilizing 
the energies and resources of communities. 

Another commonly shared assumption in the design and implementation of the various approaches 
to providing coordinated school-linked health and human services delivery is that narrow plans and 
commitments just to schools will not suffice to solve the growing problems that must be addressed to 
ensure learning success of the many children and youth who have not fared well under the current 
systems. The challenge is to understand the problems and resources that can be drawn and mobilized 
thoroughly; to help raise consciousness about the opportunities in the community, especially among those 
who are in a position to shape policies; and to provide resources to improve the prospect of learning 
success for children and youth in at-risk situations, such as those in the nation’s inner-city communities. 

Despite the fact that the research base and practical know-how in implementing school-community 
connection programs require application of knowledge and expertise from many disciplines and 
professions, no system is in place to communicate and share the growing body of related research 
findings and innovative developments among practitioners of the various fields and others who play major 
roles in influencing the conditions and process of education and health and human services delivery. 
Kirst and Kelley (1992) described operational strategies and tactics that support collaborative school- 
linked services. They called for significant changes at ail levels of school personnel, including district 
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leadership, middle management, principals, and teachers. Policymakers, on-line professionals in schools, 
and the various service delivery agencies have limited means to access a vast amount of available 
information about program features and their implementation at various locations. Even for those who 
may have access to information generated by the multiple disciplines and professions, they are perplexed 
about how to systematically link the information on the varied levels of service delivery to their site- 
specific needs and current operations. 

Despite the obvious historic and current appeal of collaborative school-linked programs, the 
evidence of their effectiveness is slimmer than required for a confident overall evaluation. To be sure, 
several programs have been adequately evaluated and show some positive effects on outcomes. Still, the 
evaluations that are made public may tend to be the ones with more positive results. Many reports 
merely describe programs and provide rudimentary information that affords little basis for recommending 
such programs in general and still less on the decisive features of successful programs. Although trite, 
it must be acknowledged that much more research and much more rigorous research designs will be 
necessary to arrive at general policy conclusions. 
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Table 1 

Agencies, Organizations, and Projects Contacted* 



Name 


Location 


Boston University, Center on Families, Communities, 
Schools, and Children’s Learning 


Boston, MA 


Brown-Campione Research Group 


CA 


California State Department of Education, Healthy Start 


Sacramento, CA 


California Tomorrow 


San Francisco, CA 


Annie E. Casey Foundation 


NJ 


Cities in Schools 


Alexandria, VA 


Clearinghouse on Educational Management 


Eugene, OR 


Columbia University, Center for Children in Poverty 


New York, NY 


Columbia University, National Resource Center 
on Service Integration 


New York, NY 


Columbia University, School of Social Work 


New York, NY 


EdSource 


Menlo Park, CA 


Education and Human Services Consortium 


Washington, DC 


Family Resource Centers 


CO and CT 


Family Resource Coalition 


Chicago, IL 


Family Resource and Youth Services Centers 


KY 


Far West Laboratory 


San Francisco, CA 


Fresno Tomorrow, K-6 Program 


Fresno, CA 


W.T. Grant Foundation 


San Francisco, CA 


Institute for Educational Leadership 


Washington, DC 


Institute for Responsive Education 


Boston, MA 


Jewish Services 


San Francisco, CA 


Joining Forces (now defunct) 


Washington, DC 


Los Angeles Educational Partnership, Focus on Youth Program 


Los Angeles, CA 



Table 1 (cont’d) 

Agencies, Organizations, and Projects Contacted* 



Name 


Location 


Maryland State Department of Education, Maryland’s Tomorrow 


Annapolis, MD 


National Clearinghouse for Alcohol and Drug Information 


Washington, DC 


National Council of Jewish Women 
National Drop Out Prevention Center 


New York, NY 


New Beginnings 


San Diego, CA 


New Futures, Center for the Study of Social Policy 


Washington, DC 


Olympia Schools Project 


Olympia, WA 


Oregon School Study Council 


Eugene, OR 


The David and Lucile Packard Foundation, 
Center for the Future of Children 


Los Altos, CA 


Philliber Research Associates 


Accord, NY 


Research and Training Associates 


Overland Park, KS 


School Based Youth Services Program 


NJ 


School in Communities Program 


NY 


Schools Partnership Project 


San Francisco, CA 


Southwest Regional Laboratory 


Los Alamitos, CA 


Stuart Foundation 


San Francisco, CA 


Student Service Centers 


Portland, OR 


Texas Education Agency 


Austin, TX 


United States Justice Department 


Washington, DC 


University of California, Graduate School of Education 


Berkeley, CA 


Ventura County Children’s Demonstration Project 


CA 


Yale University, Bush Center for Child Development 


New Haven, CT 



* Contacted for information; not all provided evaluation or research reports. 



Table 2 

Category Names and Descriptions of Information Coded for Each Source 



Category Name 


Description of Information Coded 


Author/Project 


55 sources analyzed 


Type of Source 


Program evaluations (N=31), intervention studies (N=15), 
narrative reviews (N=4), meta-analyses/quantitative syntheses 
(N=3), narrative description of a single program (N=l), 
correlational research study (N=l) 


Sample Size 


Number of clients, sites, or programs 


Characteristics of Sample 


Urban/rural, minority status, income, parental education, age, 
poor academic performance, absenteeism, pregnancy, truancy, 
alcohol/tobacco/drug use and abuse 


Program Goals 


Stated goals of the programs only 


Collaborators 


Schools, parents, peers, community service agencies, businesses, 
universities, health care providers, day care centers, foundations 
and nonprofit organizations, government 


Outcomes 


Stated outcomes of the programs, including unintended outcomes 


Evidence Reported 


Numerical, statistical, and qualitative 


Data Collection Tools 


School records, interviews, observations, pre- and posttests and 
surveys, attitude measures, achievement, intelligence and 
developmental tests, artifacts, project logs, government records 


Cost Data 


None, minimal, and cost-effectiveness or cost-benefit analysis 


Curriculum-based vs. Services 


Curriculum includes provision of information on parenting and 
pregnancy, early childhood education, sex education/family life, 
contraception, alcohol and drug education, coping/refiising skills, 
self-esteem workshops , multicultural/dominant culture awareness , 
employability, basic skills, literacy, English as a Second 
Language, alternative curricula, GED. 

Services provided can include medical screenings and checkups, 
home health and social work visits, counseling and support, day 
care, prenatal services, telephone calls, transportation, help 
accessing services, and resource centers. 



Table 3 

Type and Number of Data Sources 



Type of Source 
Program evaluation 
Intervention study 
Narrative review 

Meta-analysis/quantitative synthesis 
Narrative description of a single program 
Correlational research study 



Number of Sources 
31 
15 
4 
3 
1 
1 
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Table 10 

Positive, Neutral, and Negative Selected Outcomes 
for Each of the Six Programmatic Areas 
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The National Center on Education in the Inner Cities 



The National Center on Education in the Inner Cities (CEIC) was estabUshed on November 1, 1990 by the Temple 
Umversity Center for Research in Human Development and Education (CRHDE) in coUaboration with the University of Elinois 
at Chicago and the Umversity of Houston. CEIC is guided by a mission to conduct a program of research and development that 
seeks to improve the capacity for education in the inner cities. 

A major premise of the work of CEIC is that the challenges facing today’s children, youth, and families stem from a 
variety of political and health pressures; their solutions are by nature complex and require long-term programs of study that apply 
knowledge and expertise from many disciplines and professions. While not forgetting for a moment the risks, complexity, and 
history of the urban plight, CEIC aims to build on the resilience and "positives" of inner-city life in a program of research and 
development that takes bold steps to address the question, "What conditions are required to cause massive improvements in the 
learmng and achievement of children and youth in this nation’s inner cities?" This question provides the framework for the 
mtersection of vanous CEIC projects/studies into a coherent program of research and development. 

Grounded in theory, research, and practical know-how, the interdisciplinary teams of CEIC researchers engage in studies 
of exemplary practices as weU as primary research that includes longitudinal studies and field-based experiments. CEIC is 
organized mto four programs: three research and development programs and a program for dissemination and utilization. The 
first research and development program focuses on \ht family as an agent in the education process; the second concentrates on 
the school and factors that foster student resilience and learning success; the third addresses the community and its relevance to 
improving educational outcomes in inner cities. The focus of the dissemination and utilization program is not only to ensure that 
CEIC’s findings are known, but also to create a crucible in which the Center’s work is shaped by feedback from the field to 
maximize its usefulness in promoting the educational success of inner-city children, youth, and families. 
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